Digital Image Processing 


Image Restoration: 
Noise Removal 
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Contents 


In this lecture we will look at image 
restoration techniques used for noise removal 

-What is image restoration? 

- Noise and images 

- Noise models 

- Noise removal using spatial domain filtering 

- Periodic noise 

- Noise removal using frequency domain 
filtering 
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Image restoration 


• Image restoration is the process of 
recovering the original scene from the 
observed scene which is degraded. 

• Different form enhancement- aim of 
enhancement techniques make images 
visually appealing, whereas restoration 
essentially inverts the degradation- more 
objective. 
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Image restoration 


• Has intersections with signal processing, 
estimation theory, inverse problems, linear 
algebra. 

• As with most of the topics in Image 
Processing, restoration was developed to 
be used in astronomy, and is also used for 
restoring old films and pictures 
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What is Image Restoration? 


• Image restoration attempts to restore 
images that have been degraded 


• Identify the degradation process and 
attempt to reverse it 


-Similar to image enhancement, but more 
objective 
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Noise and Images 


The sources of noise in digital 
images arise during image 
acquisition (digitization) and 
transmission 

- Imaging sensors can be 
affected by ambient 
conditions 



- Interference can be added 
to an image during 
transmission 
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Noise Model 


We can consider a noisy image to be modelled as follows: 

g(x, y) = fix, y) + tj(x, y) 


where f(x, y) is the original image pixel, tj(x, y) is the noise term and g(x, y) is the 
resulting noisy pixel 

• If we can estimate the model of the noise in an image, this will 
help us to figure out how to restore the image 

• Noise is assumed to be uncorrelated with pixel values and does 
not depend on spatial coordinates 
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Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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There are many different 
models for the image 
noise term tj(x, y): 

-Gaussian 

• Most common model 


- Rayleigh 

- Erlang 

- Exponential 

- Uniform 

- Impulse 


Salt and pepper noise 


Noise Models 


pU) 

i 

V27TW 


0.6P7 

V27rtf 





P(z) 

Uniform „ 

_ *b 


Pa 


Impulse 


z 


b 


z 


































10 

of 

46 


Noise models 


• Noise is characterized by its probability 
density function. Some of which are: 

• Gaussian, Rayleigh, Uniform, Exponential, 
etc. 

• By far Gaussian is the most popular 
model, because: 

- It is present widely in practice 

- Mathematical ease 



Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Example 


• The test pattern to the right 
is ideal for demonstrating the 
addition of noise 

• The following slides will 
show the result of adding 
noise based on various 
models to this image 



Image 



Histogram 





■py Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Example (cont...) 



Gaussian 


Rayleigh 


Erlang 
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Identifying noise model 


If the imaging system is available we can 
capture images of a uniform gray value 
object, example a black board uniformly 
illuminated. 

If images from the system are given, look 
for part of images which are uniform. 
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Identifying noise 


Observing the histogram we can figure out 
which model the noise comes from. 



a b c 

FIGURE 5.6 Histograms computed using small strips (shown as inserts) from (a) the Gaussian, (b) the Rayleigh, 
and (c) the uniform noisy images in Fig. 5.4. 




























Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Example (cont...) 
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Estimation of noise parameters 


Noise is characterized by the pdf, which in turn 
depends on certain parameters. 

For example the Gaussian model depends only 
on the mean and variance and can easily be 
computed from the histogram. 

M = X] Z iP( Z i) 

Zi(zS 

(T 2 = ^ (Zi - /u) 2 p(Zi) 

Zi£S 

where p(zi) is the normalized histogram values. 
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Restoration in presence of noise 


Degradation model: g = f + n 
Restoration = Enhancement 

- Mean filtering, Median filtering, Notch filters. 

Some new ones: 

- Geometric mean filter, Harmonic mean 
filters, Midpoint filter, etc. 
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Filtering to Remove Noise 


We can use spatial filters of different kinds 
to remove different kinds of noise 

The arithmetic mean filter is a very simple 
one and is calculated as follows: 

f(x,y) = — YjS(s,t) 

mn (3S)SS V 

This is implemented as the 
simple smoothing filter 

Blurs the image to remove 
noise 


V 9 

V 9 

V 9 

V 9 

v 9 

v 9 

V 9 

v 9 

v 9 










Original Image x 


54 

52 

57 

55 

56 

52 

51 

50 

49 

51 

50 

52 

53 

58 

51 

204 

52 

52 

0 

57 

60 

48 

50 

51 

49 

53 

59 

63 

49 

51 

52 

55 

58 

64 

67 

148 

154 

157 

160 

163 

167 

170 

151 

155 

159 

162 

165 

169 

172 


Image f(x,y) 


Removal Example 



y 


Image f(x,y) 



































20 

of 

46 


Other Means 


There are different kinds of mean filters all of 
which exhibit slightly different behaviour: 

- Geometric Mean 

- Harmonic Mean 

- Contraharmonic Mean 
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Other Means (cont...) 


There are other variants on the mean which 
can give different performance 

Geometric Mean: 


/(*, y ) 


(stfeSxy 


mn 


Achieves similar smoothing to the arithmetic 
mean, but tends to lose less image detail 
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Other Means (cont...) 


Harmonic Mean: 


f(x,y) 


mn 


Z — 


Works well for salt noise, but fails for pepper 
noise 


Also does well for other kinds of noise such 
as Gaussian noise 
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Other Means (cont...) 


Contraharmonic Mean: 

Y,§(s,t) Q+l 


f(x,y) 


(s,t)eS xy 

^8(s 9 f) Q 

(stfeSxy 


Q is the order of the filter and adjusting its 
value changes the filter’s behaviour 

Positive values of Q eliminate pepper noise 

Negative values of Q eliminate salt noise 
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vjv Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Removal Examples 


Original 

Image 


After A 3*3 
Arithmetic 
Mean Filter 



Image 
Corrupted 
By Gaussian 
Noise 


After A 3*3 
Geometric 
Mean Filter 











^ Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Removal Examples (cont...) 


Image 
Corrupted 
By Pepper 
Noise 


Result of 
Filtering Above 
With 3*3 
Contraharmonic 
Q=1.5 





Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Removal Examples (cont...) 




Image 
Corrupted 
By Salt 
Noise 


Result of 
Filtering Above 
With 3*3 
Contraharmonic 
Q=-1.5 





taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Contraharmonic Filter: Here Be Dragons 


Choosing the wrong value for Q when using 
the contraharmonic filter can have drastic 
results 



w 

CD 

O) 

E 



Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Order Statistics Filters 


Spatial filters that are based on ordering the 
pixel values that make up the 
neighbourhood operated on by the filter 

Useful spatial filters include 

- Median filter 

- Max and min filter 

- Midpoint filter 

-Alphatrimmed mean filter 
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Median Filter: 


Median Filter 


/v 

f(x, y) = median{g(s,t)} 

Excellent at noise removal, without the 
smoothing effects that can occur with other 
smoothing filters 

Particularly good when salt and pepper 
noise is present 
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Max Filter: 

/V 

f(x,y)= max {g0,0} 

(s,t)eS xy 

Min Filter: 

/\ 

f(x,y)= min {#0,0} 

(s,t)eS„ 


Max filter is good for pepper noise and min 
is good for salt noise 
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Midpoint Filter 


Midpoint Filter: 


/(*> 3 ') = ^ 


max {g(s,?))+ min {g0,0} 


(s,t)eS 


*y 


(s,t)eS 


*y 


Good for random Gaussian and uniform 
noise 
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Alpha-Trimmed Mean Filter 


Alpha-Trimmed Mean Filter: 

/(*> y ) = —^—7 

mn-d („ )eS , 

We can delete the d/2 lowest and d/2 highest 
grey levels 

So g r (s, t) represents the remaining mn-d 
pixels 
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taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Removal Examples 


w 

CD 

O) 



Image 
Corrupted 
By Salt And 
Pepper Noise 


Result of 2 
Passes With 
A 3*3 Median 
Filter 


.mi Mi 

• • 




Result of 1 
Pass With A 
3*3 Median 
Filter 
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Result of 3 
Passes With 
A 3*3 Median 
Filter 






Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Removal Examples (cont...) 


Image 
Corrupted 
By Pepper 
Noise 



Result Of 
Filtering 
Above 
With A 3*3 
Max Filter 



Image 
Corrupted 
' By Salt 
Noise 


• Result Of 
Filtering 
•Above 
With A 3*3 
Min Filter 






vjv Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Noise Removal Examples (cont...) 


Image 
Corrupted 
By Uniform 
Noise 

Filtered By 
5*5 Arithmetic 
Mean Filter 


Filtered By 
5*5 Median 
Filter 



Image Further 
Corrupted 
By Salt and 
Pepper Noise 

Filtered By 
5*5 Geometric 
Mean Filter 


Filtered By 

5*5 Alpha-Trimmed 

Mean Filter 
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Adaptive Filters 


• The filters discussed so far are applied to an 
entire image without any regard for how image 
characteristics vary from one point to another 

• The behaviour of adaptive filters changes 
depending on the characteristics of the image 
inside the filter region 

• We will take a look at the adaptive median filter 
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Adaptive filters for handling noise 


Adapts to some statistical measures on a 
local neighborhood, usually mean and 
variance: 

- g(i,j): the noisy image gray-level value. 

- 2 : noise variance in the image. 

- ° n : local mean in neighborhood. 

jjl l 

- 2 : local variance in neighborhood. 

a L 

vi could be estimated from an uniform area 
in the given image. 
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Adaptive local noise reduction filter 


If noise variance is zero Indicates no 
noise return the observed image. 

If local variance is high compared to the 
noise variance presence of edge or a 
sharp feature-^ return a value close to 
observed grey-value. 

If two variances are equals presence of 
noised return the arithmetic mean 
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4 °< Adaptive local noise reduction filter 


Filter equation: 
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f(x, y) = g{x,y) -£ [g(x, y) - m L ] 
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Adaptive filter output 


a b 
c d 

FIGURE 5.13 

(a) Image 
corrupted by 
additive Gaussian 
noise of zero 
mean and 
variance 1000. 

(b) Result of 
arithmetic mean 
filtering. 

(c) Result of 
geometric mean 
filtering. 

(d) Result of 
adaptive noise 
reduction 
filtering. All filters 
were of size 
7x7. 
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Adaptive Median Filtering 


• The median filter performs relatively well on 
impulse noise as long as the spatial density of the 
impulse noise is not large 

• The adaptive median filter can handle much more 
spatially dense impulse noise, and also performs 
some smoothing for non-impulse noise 

• The key insight in the adaptive median filter is that 

the depending on the 

characteristics of the image 



49 

of 

46 


Adaptive Median Filtering (cont...) 


Remember that filtering looks at each 
original pixel image in turn and generates 
a new filtered pixel 

First examine the following notation: 

- z min = minimum grey level in S 

- z,„ 0 , = maximum grey level in S v 

- z med = median of grey levels in S xy 
-z xy = grey level at coordinates (x, y) 

- S max =maximum allowed size of S 
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Adaptive Median Filtering (cont...) 


Level A: 

■4 1 Z med Z m in 
— Z mec j z max 

IfAl >0 and A2 < 0, Go to level B 
Else increase the window size 

Level B: 

If window size < S max repeat level A 
Else output z 

R / - 7 - 7 

^xy ^’inin 

B2 —7 — 7 

^xy ^max 

If B1 > 0 and B2 < 0, output z xy 

Else output z med 
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Adaptive Median Filtering (cont...) 


The key to understanding the algorithm is to 
remember that the adaptive median filter 
has three purposes: 

- Remove impulse noise 

- Provide smoothing of other noise 

- Reduce distortion 



■f* Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Adaptive Filtering Example 



Image corrupted by salt 
and pepper noise with 
probabilities P a = P b = 0.25 



Result of filtering with a 7 Result of adaptive 
* 7 median filter median filtering with i = 7 




Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Periodic Noise 


•It arises due to 
electrical or electromagnetic 
interference 

• Gives rise to regular noise 
patterns in an image 

• Frequency domain 

techniques in the Fourier 
domain are most effective 
at removing periodic 
noise 
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Band Reject Filters 


• Removing periodic noise form an image 
involves removing a particular range of 
frequencies from that image 

• The reject !ilters can be used for this purpose 


An ideal band reject filter is given as follows: 
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Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Band Reject Filters (cont...) 


The ideal band reject filter is shown below, 
along with Butterworth and Gaussian 
versions of the filter 





Ideal Band 
Reject Filter 



Butterworth 
Band Reject 
Filter (of order 1) 


Gaussian 
Band Reject 
Filter 















Images taken from Gonzalez & Woods, Digital Image Processing (2002) 
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Band Reject Filter Example 



Image corrupted by Fourier spectrum of 
sinusoidal noise corrupted image 



Butterworth band Filtered image 
reject filter 
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Summary 


• In this lecture we will look at image 
restoration for noise removal 

• Restoration is slightly more objective than 
enhancement 

• Spatial domain techniques are particularly 
useful for removing random noise 

• Frequency domain techniques are 
particularly useful for removing periodic noise 



